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ABILITY-REQUIREMENT  FACTORS  FOR  GENERAL  JOB  ELEMENTS 

In  previous  articles,  Ballentine,  Cunningham,  and  Wimpee  (1992)  and  Cunningham, 
Wimpee,  and  Ballentine  (1990)  proposed  nomothetic  job  analysis  as  a  useful  supplement  to  the 
military  job-task  inventory  method  (Christal  &  Weissmuller,  1988).  In  comparison  to  job-task 
inventories,  nomothetic  job  analysis  questionnaires  contain  more  general  descriptors  applicable 
to  wide  ranges  of  jobs.  Examples  of  the  more  generic  or  nomothetic  job  elements  can  be  found 
in  structured  job  analysis  questionnaires  such  as  the  Position  Analysis  Questionnaire  (PAQ; 
McCormick,  Jeanneret,  &  Mecham,  1972),  Job  Element  Inventory  (JEI;  Cornelius,  Hakel,  & 
Sackett,  1979),  Occupation  Analysis  Inventory  (OAI;  Cunningham,  Boese,  Neeb,  &  Pass,  1983), 
General  Work  Inventory  (GWI;  Cunningham  et  al.,  1990),  and  Common  Metric  Questionnaire 
(CMQ;  Harvey,  1991).  Although  some  exploratory  research  has  been  conducted  with  the  PAQ, 
JEI,  and  GWI  in  military  settings,  the  nomothetic  approach  has  seen  limited  use  in  military  job 
analysis  to  date. 

In  addition  to  their  advantage  in  describing,  comparing,  and  grouping  a  broad  spectrum  of 
jobs,  nomothetic  job  descriptors  (NJDs)  are  potentially  linkable  to  measurable  human  attributes, 
such  as  basic  abilities  and  skills,  general  vocational  capabilities,  and  work-related  interests  and 
needs.  A  proposed  means  of  linking  NJDs  to  human  attributes  has  been  termed  the  job 
component”  approach  (McCormick,  1979),  under  which  (a)  a  universal  set  of  job  components 
(NJDs  or  NJD  factors)  is  developed  and  (b)  requirement  weights  are  derived  for  the  components 
on  various  human  attributes.  Subsequently,  attribute-requirement  estimates  can  be  derived  for 
any  job  that  has  been  rated  or  scored  on  the  weighted  components.  This  approach  is  depicted  in 
Figure  1,  which  shows  a  matrix  of  requirement  weights  of  q  job  components  for  k  defined  human 
attributes.  Based  on  this  matrix,  a  job’s  estimated  requirement  for  attribute  1,  for  example,  could 
be  derived  by  taking  the  sum  of  cross-products  of  the  job’s  scores  on  the  q  components  times  the 
components’  corresponding  weights  for  attribute  1  (or  by  some  alternative  algorithm  for 
combining  job  scores  and  requirement  weights;  cf.  Sparrow,  1989). 
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Figure  1.  Requirement  weights  of  q  job  components  on  k  human  attributes. 

Although  applicable  to  job-task  inventories,  this  method  is  considerably  more  expensive  in 
that  context  because  of  the  necessity  of  developing  a  weight  matrix  specific  to  every  inventory. 
The  job  component  approach  also  promises  some  potential  advantages  over  another  alternative, 
direct  global  ratings  of  a  job’s  attribute  requirements.  Once  a  weight  matrix  as  depicted  in 
Figure  1  is  established,  a  job’s  attribute  requirements  can  be  estimated  from  ratings  by  any 
knowledgeable  respondent  (e.g.,  literate  incumbents  or  line  supervisors)  on  relatively  concrete 
NJDs  representing  observable  work  activities  and  conditions  (Cunningham  et  al.,  1990).  In 
comparison,  direct  job  ratings  on  the  more  abstract  attribute  definitions  might  be  too  demanding 
for  some  otherwise  qualified  NJD  raters.  Moreover,  the  job  component  approach  provides  a 
basis  for  explaining  why  a  job  requires  particular  attributes  (i.e.,  because  it  involves  specific 
NJDs  with  those  requirements),  as  opposed  to  relying  entirely  on  the  expert  judgment  argument 
inherent  in  a  job’s  direct  attribute  requirement  ratings.  Based  on  the  Spearman-Brown  principle, 
job  component  estimates  of  ability  requirements  should  also  show  higher  reliabilities  per 
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respondent,  because  they  are  derived  from  the  respondent’s  ratings  on  a  number  of  weighted 
NJDs,  rather  than  from  single  global  job  ratings  on  each  attribute  requirement. 

There  are  two  basic  ways  of  deriving  attribute-requirement  weights  for  job  components:  (a) 
attribute-requirement  ratings  of  the  components  by  experts  and  (b)  policy  capturing  (Christal, 
1968),  involving  regression  analysis  in  which  jobs'  component  scores  serve  as  predictor  (x) 
variables  and  some  external  measure  of  the  jobs'  requirements  for  a  particular  attribute  serves  as 
the  criterion  (y)  variable.  Under  the  policy-capturing  method,  the  derived  regression  coefficients 
subsequently  serve  as  the  components'  attribute-requirement  weights.  Two  criterion  variables 
have  been  used  with  some  success  in  policy  capturing  ability  requirements:  (a)  mean  test  scores 
for  representative  job  incumbent  samples  and  (b)  test  validity  coefficients  for  jobs  (McCormick 
et  al.,  1972;  Cunningham  et  al.,  1983).  Neither  of  these  two  criteria,  however,  have  shown  much 
differentiation  among  abilities.  Thus  two  factors  (Cognitive  and  Motor)  accounted  for  80%  of 
the  variance  in  incumbent  mean  scores  for  434  jobs  on  eight  U.  S.  Employment  Service  General 
Aptitude  Test  Battery  tests,  and  three  factors  (Cognitive,  Motor,  and  Perceptual)  accounted  for 
77%  of  the  variance  in  the  validity  coefficients  for  those  tests  (Cunningham  &  Scott,  1988; 
Hunter,  1983).  From  a  practical  standpoint,  moreover,  mean  incumbent  test  scores  and  validity 
coefficients  are  difficult  and  expensive  to  obtain  for  representative  samples  of  jobs.  Probably  for 
that  practical  reason,  the  first  of  the  aforementioned  methods  (expert  ratings)  is  the  one  most 
frequently  used  to  derive  job  components'  ability  weights  (Peterson  &  Bownas,  1982). 

The  job  component  approach  has  been  applied  with  at  least  four  general  nomothetic  job 
analysis  questionnaires:  the  Worker  Activity  Profile  (McCormick,  Cunningham,  &  Thornton, 
1967);  the  PAQ  (McCormick  et  al.,  1972;  McCormick,  DeNisi,  &  Shaw,  1979;  McCormick  & 
Jeanneret,  1988);  the  OAI  (Cunningham  et  al.,  1983;  Cunningham,  1988;  Cunningham  &  Scott, 
1988);  and  the  GWI  (Cunningham  et  al.,  1990).  Except  for  analyses  of  PAQ  data,  however, 
relationships  among  ability-requirement  estimates  for  generic  job  elements  have  received  little 
attention  (Jeanneret  &  McCormick,  1969;  Marquardt  &  McCormick,  1973).  Accordingly,  the 
study  reported  here  explored  the  factor  structures  underlying  average  ability-requirement  rating 
matrices  (as  depicted  in  Figure  1)  derived  for  three  of  the  forenamed  instruments:  the  PAQ,  OAI, 
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and  GWI.  Cross-instrument  comparisons  were  carried  out  among  the  resultant 
ability-requirement  factors  in  an  effort  to  establish  their  convergent  validity.  The  study  was  not 
designed  to  assess  the  instruments  involved,  but  rather  to  explore  the  dimensionality  and 
cross-system  commonality  of  NJD  ability-requirement  ratings. 

METHOD 

Instruments 

Job  analysis  questionnaires.  As  mentioned,  the  present  study  included  three  nomothetic  job 
analysis  questionnaires  (the  PAQ,  OAI,  and  GWI).  The  PAQ,  the  most  widely  used  and 
researched  structured  job  analysis  questionnaire,  contains  194  mostly  "worker-oriented"  elements 
describing  basic  human  activities,  as  contrasted  with  "job-oriented"  elements  which  describe  the 
technological  content  and  outcomes  of  work  (cf.  McCormick  &  Jeanneret,  1988).  The  OAI  is  a 
taxonomic  research  tool  containing  a  mixture  of  617  worker-  and  job-oriented  elements,  and  the 
GWI  is  a  268-element  questionnaire  derived  partly  from  selected  OAI  factors  and  modified  or 
merged  OAI  elements.  In  addition  to  being  considerably  shorter  than  the  OAI,  the  GWI  is 
written  at  a  less  technical  level  and  is  intended  for  use  by  any  literate  respondent  who  is  familiar 
with  the  job  to  be  analyzed.  GWI  position  ratings  have  been  performed  by  over  2,100 
incumbents  in  164  Air  Force  enlisted  specialties  (Cunningham  et  al.,  1990).  Substantial 
differences  between  the  GWI  and  OAI  elements,  plus  the  use  of  different  ability-requirement 
inventories  and  raters  with  these  two  instruments,  warranted  including  them  both  in  this  study. 
Ability-requirement  inventories.  Three  ability-requirement  instruments  were  combined  with  the 
forenamed  job  analysis  questionnaires,  as  follows:  (a)  a  specially  developed  set  of 
ability-requirement  definitions  that  were  applied  to  the  PAQ  job  elements  (Mecham  & 
McCormick,  1969;  Marquardt  &  McCormick,  1972);  (b)  the  Attribute  Requirement  Inventory 
(ARI),  applied  to  the  OAI  elements  (Neeb,  Cunningham,  &  Pass,  1971;  Pass  &  Cunningham, 
1975);  and  (c)  Fleishman's  Manual  for  Ability  Requirement  Scales  (MARS),  applied  to  the  GWI 
elements  (Fleishman,  1975,  1990;  Fleishman  &  Quaintance,  1984;  Fleishman  &  Mumford, 
1988).  The  MARS  (now  titled  the  Fleishman  Job  Analysis  Survey;  Fleishman  &  Reilly,  1992) 
was  selected  for  this  study  because  it  is  the  most  rigorously  developed  and  widely  used  of  the 
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ability-requirement  inventories  (Landy,  1988);  the  ARI  and  PAQ  attribute  scales  were  used  in 
two  previous  studies  that  provided  comparative  data.  Table  1  lists  the  titles  of  the  basic  abilities 
defined  in  the  three  instruments.  Ability  titles  whose  definitions  are  comparable  across 
instruments  appear  on  the  same  line  in  the  table.  The  PAQ,  ARI,  and  MARS  sets  contained 
totals  of  49,  38,  and  54  basic  ability  definitions,  respectively.  (Nine  of  the  original  65  MARS 
ability  items  were  too  content  or  knowledge  specific  for  use  in  the  present  study.)  A  substantial 
number  of  these  definitions  corresponded  to  cognitive  factors  identified  by  French,  Ekstrom,  and 
Price  (1963)  and  psychomotor  factors  derived  by  Fleishman  (1967). 

Table  1.  Titles  and  Reliabilities  of  Ability  Requirements  in  Three  Data  Sets:  MARS-GWI,  ARI- 
OAI,  and  PAQ 


MARS-GWI 

ARI-OAI 

PAQ 

1. 

Fluency 

1. 

Ideational 

1. 

Ideational 

of  Ideas  (.91) 

Fluency  (.91) 

Fluency  (.90) 

2. 

Originality  (.89) 

2. 

Originality  (.96) 

2. 

Originality  (.86) 

3. 

Problem 

3. 

Sensitivity 

3. 

Problem 

Sensitivity  (.62) 

to  Problems  (.88) 

Sensitivity  (.88) 

4. 

Number  Facility  (.77) 

4. 

Number  Facility  (.96) 

4. 

Numerical  Computation  (.92) 

5. 

Spatial 

5. 

Spatial 

5. 

Spatial 

Orientation  (.82) 

Orientation  (.90) 

Orientation  (.88) 

6. 

Visualization  (.62) 

6. 

Visualization  (.94) 

6. 

Spatial  Visualization  (.90) 

7. 

Multilimb 

7. 

Multilimb 

7. 

Kinesthesis  (.96) 

Coordination  (.90) 

Coordination  (.92) 

8. 

Rate 

8. 

Control 

8. 

Rate 

Control  (.81) 

Precision3  (.95) 

Control  (.87) 

9. 

Reaction  Time  (.83) 

9. 

Reaction  Time  (.92) 

9. 

Simple  Reaction  Time  (.80) 

10. 

Arm-Hand 

10. 

Arm-Hand 

10. 

Arm-Hand 
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Steadiness  (.92)  Steadiness  (.93)  Steadiness  (.88) 

11.  Manual  Dexterity  (.90)  11.  Manual  Dexterity  (.96)  11.  Manual  Dexterity  (.94) 

12.  Finger  Dexterity  (.88)  12.  Finger  Dexterity  (.90)  12.  Finger  Dexterity  (.93) 

Table  1  (continued) 


MARS-GWI  ARI-OAI  PAQ 


13.  Static  Strength  (.90)  13.  Static  Strength  (.95) 

14.  Explosive  Strength  (.91)  14.  Explosive  Strength  (.85) 

15.  Dynamic  Strength  (.89)  15.  Dynamic  Strength  (.94) 

16.  Body  16.  Body 

Equilibrium  (.85)  Orientation  (.85) 


13.  Static  Strength  (.91) 

14.  Explosive  Strength  (.83) 

15.  Dynamic  Strength  (.84) 

16.  Gross  Body 
Equilibrium  (.91) 

17.  Stamina  (.88) 

18.  Near 
Vision  (.88) 

19.  Far  Vision  (.92) 

20.  Depth  Perception  (.87) 

21.  Visual  Color 
Discrimination  (.80) 

22.  General  Hearing  (.86) 

23.  Oral 

Comprehension  (.91) 

24.  Written 
Comprehension1"  (.90) 

25.  Oral 
Expression  (.96) 

26.  Written 
Expression1"  (.95) 


17.  Stamina  (.89) 

18.  Near 

Visual  Acuity  (.93) 

19.  Far  Visual  Acuity  (.93) 

20.  Depth  Perception  (.92) 

21.  Color 
Discrimination  (.93) 

22.  Auditory  Acuity  (.92) 

23.  Verbal 
Comprehension  (.97) 


24.  Expressional 
Fluency  (.97) 


17.  Stamina  (.90) 

18.  Near 

Visual  Acuity  (.91) 

19.  Far  Visual  Acuity  (.92) 

20.  Depth  Perception  (.93) 

21.  Color 
Discrimination  (.90) 

22.  Auditory  Acuity  (.93) 

23.  Verbal 
Comprehension  (.96) 


24.  Word 
Fluency  (.94) 

25.  Oral 

Communicationb(.96) 
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27.  Memorization  (.82) 


25.  Memory  (.84) 


26.  Long  Term  Memory  (.90) 


27.  Short  Term  Memoryb  (.86) 


Table  1  (continued) 


MARS-GWI  ARI-OAI  PAQ 


28.  Deductive 
Reasoning  (.68) 

29.  Inductive 
Reasoning*5  (.79) 

30.  Grammar  (.93) 

31.  Spelling  (.92) 

32.  Perceptual  Speed  (.57) 

33.  Mathematical 
Reasoning  (.84) 

34.  Selective  Attention  (.62) 

35.  Time  Sharing  (.33) 

36.  Control  Precision  (.71) 

37.  Speed  of  Limb 
Movement  (.81) 


26.  Deductive 
Reasoning  (.93) 

27.  Inductive 
Reasoning*5  (.90) 

28.  Grammar  (.97) 

29.  Spelling  (.97) 

30.  Perceptual  Speed  (.94) 


31.  Aesthetic 
Judgment  (.98) 

32.  Form 
Perception  (.93) 

33.  Eye-Hand 
Coordination  (.95) 


28.  Convergent 
Thinking  (.87) 


29.  Arithmetic 
Reasoning  (.90) 

30.  Selective  Attention  (.91) 

3 1 .  Time  Sharing  (.90) 

32.  Arm-Hand  Positioning  (.95) 

33.  Speed  of  Limb 
Movement  (.95) 

34.  Aesthetic 
Judgment  (.82) 

35.  Visual  Form 
Perception  (.94) 

36.  Eye-Hand 
Coordination  (.94) 
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34.  Tactual 


37.  Tactual 


.  Discrimination  (.89)  Acuity  (.94) 

.  35.  Closure  (.88)  38.  Closure  (.87) 

38.  Information  Ordering  (.87)  .  . 

39.  Category  Flexibility  (.79)  .  . . 

Table  1  (continued) 


MARS-GWI  ARI-OAI 


PAQ 


40.  Response  Orientation  (.63) 

41 .  Wrist-Finger  Speed  (.72) 

42.  Trunk  Strength  (.80) 

43.  Extent  Flexibility  (.84) 

44.  Dynamic  Flexibility  (.86) 

45.  Gross  Body 
Coordination  (.88) 

46.  Night  Vision  (.89) 

47.  Peripheral  Vision  (.86) 

48.  Glare  Sensitivity  (.79) 

49.  Auditory  Attention  (.84) 

50.  Sound  Localization  (.83) 

5 1 .  Speech  Hearing  (.93) 

52.  Speech  Clarity  (.93) 

53.  Speed  of  Closure0  (.58) 

54.  Flexibility  of  Closure0  (.65) 


36.  Spatial  Scanning  (.84) 

37.  Social  Intelligence  (.97) 
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38.  Musical  Aptitude  (.97) 


.  .  39.  Movement  Detection  (.88) 

.  40.  Olfactory  Acuity  (.92) 

.  41.  Gustatory  Acuity  (.87) 

.  42.  Divergent  Thinking  (.91) 

.  43.  Intelligence  (.94) 

Table  1  (continued) 


MARS-GWI  ARI-OAI 


PAQ 


Note.  The  following  scales  were  used  to  rate  the 


MARS-GWI 


ARI-OAI 


. .  44.  Continuous 

Muscle  Control  (.93) 

. .  45.  Rate  of  Arm  Movement  (.93) 

.  46.  Eye-Hand-Foot 

Coordination  (.92) 

.  47.  Response  Integration  (.91) 

.  48.  Mechanical  Ability  (.84) 

. . 49.  Perceptual  Speed0  (.88) 

ability  requirements  of  the  job  elements: 

PAQ 


0  =  Unimportant 

1  =  Somewhat  Important 

2  =  Moderately  Important 

3  =  Important 

4  =  Very  Important 


0  =  Does  not  apply 

1  =  Very  limited 

relevance 

2  =  Limited  relevance 

3  =  Moderate  relevance 

4  =  Substantial  relevance 

5  =  Very  high  relevance 


0  =  Attribute  is  of  no  relevance 
to  job  element 

1  =  Very  limited 

or  nominal  relevance 

2  =  Limited  relevance 

3  =  Moderate  relevance 

4  =  Substantial  or  considerable 

relevance 

5  =  Extreme  or  extensive 

relevance 
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aThe  ARI  definition  of  Control  Precision  was  judged  to  correspond  with  the  definitions  of  Rate 
Control  in  the  other  two  data  sets. 

bThis  ability  was  merged  with  the  one  immediately  above  it  to  form  a  better  match  with  broader 
definitions  in  one  or  both  of  the  other  data  sets. 

'Because  of  a  judged  lack  of  correspondence,  this  definition  was  not  matched  with  definitions 
under  the  same  (or  similar)  title  in  the  other  two  data  sets. 


Procedures 

Each  element  in  the  three  job  analysis  questionnaires  was  rated  on  its  requirement  for  each 
basic  ability  in  the  set  that  was  applied  to  its  questionnaire  (see  Table  1).  The  PAQ  and  ARI-OAI 
data  were  available  from  previous  research,  whereas  the  MARS-GWI  data  were  collected 
specifically  for  this  study.  The  PAQ  and  ARI-OAI  ability-requirement  ratings  were  performed 
with  6-point  “Degree  of  Relevance  (of  the  ability  to  the  element)  scales,  and  the  MARS-GWI 
ratings  were  performed  with  a  specially  constructed  “Importance”  (of  the  ability  to  the  element) 
scale.  The  original  behaviorally  anchored  MARS  rating  scales,  involving  level  of  ability 
required,  were  not  applied  to  the  GWI  job  elements  in  this  study  because  of  their  possible 
confounding  with  level  ranges  within  the  elements  (i.e.,  because  of  the  problem  inherent  in 
judging  level  of  ability  required  by  an  element  that  can  involve  different  levels  of  difficulty). 
Instead,  the  MARS  scales  were  included  as  part  of  the  ability  definitions  that  were  rated  on  the 
Importance  scale.  The  rating  scales  used  in  this  study  are  shown  in  the  note  for  Table  1.  For 
each  ability  definition,  the  PAQ  ratings  were  carried  out  by  8-11  industrial  psychologists 
(Marquardt  &  McCormick,  1973);  the  ARI-OAI  ratings,  by  19-20  psychology  graduate  students; 
and  the  MARS-GWI  ratings,  by  6-14  psychologists,  human  resource  managers,  Air  Force 
occupational  analysts,  and/or  psychology  graduate  students. 

A  job  element’s  requirement  weight  for  a  particular  ability  was  derived  by  computing  its 
average  over  the  judges'  ratings.  This  produced  a  profile  of  average  requirement  ratings  for  each 
element  on  all  abilities,  which  in  combination  with  the  average  profiles  for  the  other  elements  in 
its  job  analysis  questionnaire,  produced  an  element-by-ability  matrix  of  average  ratings  as 
depicted  in  Figure  1.  Matrices  of  the  order  182-by-49,  545-by-38,  and  217-by-49  were  compiled 


10 


from  the  PAQ,  ARI-OAI,  and  MARS-GWI  ratings,  respectively.  (In  all  three  instruments,  some 
of  the  original  elements  were  omitted  as  inappropriate  for  ability-requirement  ratings.)  The 
entries  in  the  ARI-OAI  and  MARS-GWI  matrices  were  mean  ratings,  whereas  those  in  the  PAQ 
matrix  were  median  ratings.  The  reliability  of  each  ability  column  in  each  matrix  was  estimated 
by  a  repeated  measures  analysis-of-variance  procedure,  in  which  judges  represented  categories  of 
a  factor,  the  job  elements  were  cases  on  which  repeated  measures  were  taken,  and  the  ability- 
requirement  ratings  were  the  measures  (Winer,  1971).  This  analysis  produced  an  estimated 
reliability  for  the  elements’  mean  ratings  on  each  ability;  that  is,  an  estimated  correlation 
between  an  abilities  mean  rating  vector  and  a  corresponding  vector  obtained  from  a  new  sample 
of  comparable  judges.  The  resultant  reliability  coefficients  for  the  PAQ  ranged  from  .80  to  .96, 
with  a  mean  value  of  .90  (median=.91;  Marquardt  &  McCormick,  1973);  those  for  the  ARI-OAI, 
from  .84  to  .98,  with  a  mean  value  of  .92  (median=.92;  Pass  &  Cunningham,  1975);  and  those  for 
the  MARS-GWI,  from  .33  to  .96,  with  a  mean  value  of  .81  (median=.84). 

Table  1  presents  the  reliability  coefficients  for  the  individual  abilities.  With  only  one 
exception  (the  value  of  .33  for  Time  Sharing  in  the  MARS-GWI  column),  all  of  these  reliability 
values  are  more  than  sufficient  for  research  purposes.  It  should  be  noted  that  the  MARS-GWI 
reliabilities  are  based  on  (a)  a  specially  constructed  Importance  scale  rather  than  the  behaviorally 
anchored  MARS  scales  and  (b)  smaller  and  more  heterogeneous  rater  sets  than  recommended;  . 
The  MARS-GWI  scale  contained  fewer  points  than  the  original  MARS  scales  (or  the  ARI-OAI 
and  PAQ  scales),  and  the  points  were  marked  only  with  adjective  descriptors.  Hence,  the 
MARS-GWI  reliabilities  reported  here  underestimate  those  from  more  typical  ratings  of  tasks  or 
work  activities  on  the  regular  MARS  scales  (Fleishman  &  Mumford,  1988).  It  should  also  be 
mentioned  that  the  coefficients  in  Table  1  estimate  the  reliabilities  of  ,mean  ratings,  whereas  the 
entries  in  the  PAQ  ability-requirement  matrix  were  medians,  nevertheless  these  reliabilities  can 
be  accepted  as  reasonable  stability  estimates  for  the  PAQ  median  ability  vectors  as  well,  because 
the  median  vectors  correlated  very  highly  (.97)  with  corresponding  mean  vectors  (Marquardt  & 
McCormick,  1973). 
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Analyses  and  Results 

A  separate  factor  analysis  was  performed  on  each  of  the  three  data  sets.  The  ability- 
requirement  columns  were  intercorrelated  in  each  of  the  previously  described  element-by-ability 
matrices,  and  the  resultant  correlation  matrix  was  subjected  to  principal  axes  analysis  using 
squared  multiple  correlations  as  communality  estimates.  The  appropriate  number  of  factors,  as 
initially  estimated  by  examination  of  the  eigenvalue  pattern  (Cattell,  1966),  was  then  rotated  to  a 
normalized  varimax  solution  (Kaiser,  1958;  Sarle  &  Sail,  1982).  In  each  data  set,  two  or  three 
rotation  solutions  (involving  different  numbers  of  rotated  factors)  were  computed,  and  the  most 
meaningful  result  was  retained.  In  a  factor  replication  analysis,  the  judges  contributing  to  the 
MARS-GWI  data  set  were  divided  into  two  comparable  subsamples,  and  the  subsample  rating 
data  were  subjected  to  independent  factor  analyses.  Each  factor  from  the  total  sample  was  then 
matched  with  its  closest  counterpart  in  each  of  the  two  subsamples,  and  the  coefficient  of 
congruence  (cosine  between  rotated  factor  loading  vectors)  was  computed  between  the  two 
corresponding  subsample  factors  as  a  stability  estimate  (Gorsuch,  1974).  Because  only  the 
average  ability-requirement  rating  matrices  were  available  for  the  PAQ  and  ARI-OAI  data  sets, 
replication  analyses  were  not  performed  on  their  factors.  Table  2  summarizes  the  results  by 
presenting  the  title,  percentage  of  variance  accounted  for,  and  salient  abilities  and  loadings  for 
each  of  the  rotated  ability-requirement  factors.  The  salient  abilities  are  designated  in  Table  2  by 
numbers  corresponding  to  their  title  locations  in  Table  1.  Congruence  coefficients  are  presented 
for  the  MARS-GWI  factors.  The  MARS-GWI,  ARI-OAI,  and  PAQ  factor  solutions  accounted 
for  .86,  .64,  and  .84  of  their  systems'  total  variance,  respectively. 

Table  2  Ability-Requirement  Factors:  Salient  Abilities  and  Their  Loadings,  Percentages  of 
Variance  Explained,  and  Coefficients  of  Congruence 

Analysis  and  Factor  Title3  Salient  Abilities  and  Their  Loadings15 


MARS-GWI  Analysis 
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1. 


General  Physical  Ability  (19.73,  .98) 


2.  Equipment-Control  Sensorimotor  Ability 
(13.70,  .97) 

3.  Verbal  Ability  (12.32,  .92) 


42(90),  17(90),  45(90),  15(88),  44(87), 
13(83),  16(82),  43(82),  14(81),  37(75), 

7(74),  11(40) 

48(89),  47(88),  19(86),  46(85),  5(80), 

20(73),  9(72),  8(68),  40(68) 

24(86),  25(80),  1(80),  30(78),  52(75), 

2(75),  31(72),  39(59),  29(52),  38(47),  23(41) 


Table  2  (continued) 


Analysis  and  Factor  Title3 


Salient  Abilities  and  Their  Loadings15 


4.  Manual  Ability  (10.10,  .95) 

5.  Reasoning  and  Problem  Solving  (8.23,  .87) 

6.  Auditory  Ability  (7.99,  .96) 

7.  Numerical  Ability  (5.17,  .92) 

8.  Visual  Perception  (3.17,  .83) 

9.  Written  Comprehension  (2.66)c 

10.  Closure  (2.62)c 
ARI-OAI  Analysis 

1.  Manual  Ability  (10.98) 

2. 


12(88),  10(82),  11(81),  41(80),  36(78), 
18(43),  37(43) 

3(82),  35(76),  28(72),  34(63),  29(61), 
27(51),  23(42) 

22(91),  49(90),  50(85),  51(71),  52(45), 
23(42) 

33(79),  4(78),  38(61) 

6(73),  21(68) 

24(68),  18(48) 

54(60),  53(57),  32(41) 

10(85),  33(81),  12(78),  11(78),  34(66), 
8(48),  7(45),  18(41) 

28(92),  29(83),  23(77),  24(74),  1(40) 
15(86),  13(84),  14(77),  17(77) 

9(72),  19(69),  8(65),  5(65),  7(62),  20(61) 


3. 

4. 


Verbal  Ability  (8.68) 

General  Physical  Ability  (8.42) 
Equipment-Control  Sensorimotor  Ability 
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(8.11) 

5.  Reasoning  and  Problem  Solving  (7.81) 

6.  Visual  Perception  (7.17) 

7.  Numerical  Ability  (4.23) 

8.  Auditory  Ability  (3.48) 

9.  Aesthetic  Ability  (3.32) 

10.  Body  Equilibrium  (1 .88) 

Table  2  (continued) 


Analysis  and  Factor  Title3 


27(75),  2(71),  1(71),  26(70),  3(59) 
32(80),  6(73),  35(65),  36(60) 
4(60),  30(51),  25(46),  18(44) 
22(62),  37(59) 

31(74),  38(54),  21(42) 

16(42) 


Salient  Abilities  and  Their  Loadings1* 


PAQ  Analysis 

1.  General  Physical  Ability  (27.24) 

2.  Reasoning  &  Problem  Solving  (21.78) 

3.  Visual  Perception  (17.15) 

4.  Manual  Ability  (5.32) 

5.  Equipment-Control  Sensorimotor  Ability 
(3.76) 


15(94),  13(93),  33(90),  14(89),  7(88), 

45(87),  44(85),  46(82),  17(81),  47(81), 

16(80),  32(77),  36(75),  10(71),  37(70), 

11(67),  8(56),  12(53),  5(51),  9(46),  39(41) 
43(92),  31(89),  26(87),  3(87),  27(84), 

23(84),  28(81),  25(80),  24(79),  1(79), 

42(76),  30(76),  2(76),  29(63),  38(59), 

22(55),  4(44) 

35(91),  6(88),  21(83),  19(82),  20(81), 

49(79),  18(76),  5(67),  48(62),  39(61), 

38(59),  34(48),  8(42) 

12(72),  11(61),  10(57),  32(53),  36(45), 
37(43) 

9(62),  8(51),  39(51),  22(45) 
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6.  Taste-related  ability  (3.16) 

7.  Numerical  Ability  (3.04) 

8.  Mechanical  Ability  (2.23) 


41(81),  40(79) 
4(76),  29(60) 
48(42) 


aThe  two  values  in  parentheses  following  the  factor  title  are  the  factors  percentage  of  total 
variance  accounted  for  and  coefficient  of  congruence,  respectively.  Congruence  coefficients 
were  computed  in  the  MARS-GWI  analysis  only. 

bEach  salient  ability  is  represented  by  its  number,  followed  in  parentheses  by  its  loading  (with 
the  decimal  omitted).  The  ability's  title  can  be  found  in  Table  1  under  its  appropriate  number. 
cNo  coefficient  of  congruence  was  computed  because  matching  subsample  factors  failed  to 
emerge. 

For  the  purpose  of  cross-system  comparison,  a  second  group  of  factor  analyses  was 
conducted  including  only  abilities  whose  definitions  were  judged  to  be  comparable  between  data 
sets,  or  systems.  The  titles  of  comparable  abilities  appear  on  the  same  lines  in  Table  1.  As  noted 
in  Table  1,  three  pairs  of  MARS-GWI  abilities,  one  pair  of  ARI-OAI  abilities,  and  two  pairs  of 
PAQ  abilities  were  combined  when  matched  with  more  broadly  defined  abilities  in  other 
systems.  For  example,  Oral  Comprehension  and  Written  Comprehension  in  the  MARS-GWI  set 
were  combined  to  match  Verbal  Comprehension  in  the  ARI-OAI  and  PAQ  systems.  Thirty 
abilities  were  judged  comparable  between  the  MARS-GWI  and  ARI-OAI  systems,  3 1  abilities, 
between  the  MARS-GWI  and  PAQ  systems;  and  31  abilities,  between  the  ARI-OAI  and  PAQ 
systems.  Preparatory  to  comparison,  the  previously  described  factor  analytic  procedure  was 
applied  twice  to  each  system,  including  only  the  abilities  in  that  system  that  were  comparable  to 
abilities  in  each  of  the  other  two  systems.  In  the  MARS-GWI  system,  for  example,  one  factor 
analysis  was  performed  on  the  30  abilities  in  common  with  the  ARI-OAI  system,  and  a  second 
on  the  31  abilities  in  common  with  the  PAQ  system.  Similarly,  factor  analyses  of  30  and  31 
common  abilities  were  carried  out  in  the  ARI-OAI  system,  and  two  analyses  of  31  abilities  each 
in  the  PAQ  system.  Cross-system  congruence  coefficients  were  then  computed  between  rotated 
factors.  In  this  case  a  congruence  coefficient  was  the  cosine  between  two  rotated  factors  with 
loadings  on  comparable  abilities.  Table  3  presents  congruence  matrices  for  the  three  cross- 
systemcomparisons. 
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Table  3  Cross-System  Congruence  Coefficients  Between  Factors  from  Matched  Ability  Sets- 
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There  was  no  cross-instrument  pairing  of  this  factor 


The  underlined,  main-diagonal  values  in  Table  3  are  coefficients  between  factors  judged  to 
be  comparable,  and  the  remaining  values  are  coefficients  between  factors  that,  though  in  some 
instances  possibly  related,  were  not  judged  as  directly  comparable.  Each  value  in  parentheses  is 
the  mean  of  the  entry  immediately  above  it  and  that  entry's  correspondent  above  the  main 
diagonal  In  the  matrix  of  coefficients  between  the  PAQ  and  ARI-OAI  factors,  for  example,  the 
first  parenthesized  value  in  row  Mn  (.53,  at  the  intersection  of  row  Mn  and  column  GP)  is  the 
mean  of  .58  and  its  corresponding  value,  .48  (at  the  intersection  of  row  GP  and  column  Mn).  In 
each  of  the  three  matrices,  a  line  appears  below  the  last  row  that  has  a  corresponding  column 
representing  the  same  construct;  the  rows  above  that  line  form  a  square  convergent-discriminant 
matrix,  whereas  the  rows  below  the  line  represent  factors  from  the  row  data  set  that  did  not 
emerge  from  the  column  data  set.  The  values  in  parentheses  form  a  mean  discriminant  triangle. 
Table  4  presents  a  matrix  of  mean  values  of  corresponding  entries  from  the  matrices  in  Table  3. 
The  Verbal  Ability  factor  has  been  relocated  in  Table  4  to  facilitate  interpretation. 

With  one  exception  in  Table  3  (Visual  Perception,  in  the  comparison  of  the  MARS-GWI 
with  the  PAQ),  the  underlined  (convergent)  values  in  Tables  3  and  4  are  the  largest  in  their 
respective  rows  and  columns.  A  Monte  Carlo  procedure  for  multitrait-multimethod  analysis 
(Rnoeller  &  Iwaniszek,  1990)  was  applied  separately  to  each  of  the  four  square  matrices  in  the 
two  tables  to  determine  whether  the  mean  main-diagonal  (convergent)  value  was  significantly 
larger  than  the  mean  off-diagonal  (discriminant)  value  (cf.  Campbell  &  Fiske,  1959).  In  all  four 
matrices,  the  probability  that  the  observed  difference  between  the  two  means  occurred  randomly 
was  less  than  .002.  Finally,  the  four  mean  discriminant  triangles  in  Tables  3  and  4  were  cluster 
analyzed  to  explore  broader  ability-requirement  groupings.  In  these  analyses,  the  entries  in  each 
discriminant  triangle  were  converted  to  dissimilarity  indices  by  subtracting  them  from  1.00,  and 
the  transformed  triangles  were  subjected  to  hierarchical  cluster  analysis  (Sarle,  1982;  Ward  & 
Hook,  1963).  The  cluster  solution  presented  in  Table  5  was  judged  to  be  the  most  meaningful 
result.  This  solution  included  two  groupings  and  two  isolates,  titled  as  follows:  General 
Sensorimotor  Ability,  General  Cognitive  Ability,  Numerical  Ability,  and  Visual  Perception.  All 
of  the  analyses  produced  the  same  solution,  with  the  exception  that  the  two  six-factor  triangles 
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Table  4.  Mean  Cross-System  Congruence  Coefficients  Between  Factors  from  Matched  Ability 
Setsa,b,c 


GP 

EC 

Mn 

RP 

Vb 

Nm 

VP 

GP 

90 

31 

48 

-36 

-41 

-27 

13 

EC 

54 

(43) 

82 

41 

-19 

-39 

-21 

46 

Mn 

54 

(51) 

40 

(41) 

94 

-32 

-38 

-04 

33 

RP 

-27 

(-32) 

-13 

(-16) 

-29 

(-30) 

87 

74 

15 

02 

Vb 

-40 

(-40) 

-21 

(-30) 

-37 

(-37) 

66 

(70) 

85 

18 

-23 

Nm 

-40 

(-33) 

-24 

(-22) 

-18 

(-11) 

43 

(29) 

17 

(18) 

86 

-02 

VP 

-02 

(05) 

-03 

(22) 

20 

(26) 

-08 

(-03) 

-35 

(-29) 

26 

(12) 

78 

As 

-09 

-26 

02 

03 

— d 

-18 

48 

BE 

51 

20 

14 

-26 

-11 

-24 

-13 

aGP=General  Physical  Ability;  EC=Equipment-Control  Sensorimotor  Ability;  Mn=Manual 
Ability;  RP=Reasoning  &  Problem  Solving;  Vb=Verbal  Ability;  Nm=Numerical  Ability; 
VP=Visual  Perception;  As=Aesthetic  Ability;  BE=Body  Equilibrium. 
bThe  decimals  are  omitted  from  the  coefficients  of  congruence,  whose  values  can  range  from 
+1.00  to -1.00. 

cEach  value  in  parentheses  is  the  mean  of  the  entry  immediately  above  it  and  that  entry's 

correspondent  above  the  main  diagonal. 

dThere  was  no  cross-system  pairing  of  these  two  factors. 
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did  not  contain  a  Verbal  Ability  factor  (see  footnote  c  Table  5).  The  two  isolates,  Numerical 
Ability  and  Visual  Perception,  eventually  joined  the  General  Cognitive  and  General 
Sensorimotor  clusters,  respectively,  in  the  hierarchical  structure;  but  their  congruence 
coefficients  with  other  cluster  members  were  judged  as  too  small  to  justify  merger. 
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Table  5.  Clusters  from  the  Discriminant  Congruence  Coefficient  Triangles 


Ability-Requirement  Factor  Titles 

Cluster  Assignments  ’ 

Cl  C2  C3  C4 

General  Physical  Ability 

X 

Equipment-Control  Sensorimotor  Ability 

X 

Manual  Ability 

X 

Reasoning  and  Problem  Solving 

X 

Verbal  Ability 

xc 

Numerical  Ability 

X 

Visual  Perception 

X 

aThe  column  headings  represent  two  clusters  and  two  isolates,  as  follows:  Cl=  General 
Sensorimotor  Ability;  C2=General  Cognitive  Ability;  C3=Numerical  Ability;  C4=Visual 
Perception. 

b"X"  indicates  assignment  of  an  ability-requirement  factor  to  a  cluster. 

CA  Verbal  Ability  factor  was  assigned  to  this  cluster  only  in  the  analyses  of  two  discriminant 
triangles:  the  mean  triangle  and  the  triangle  between  the  ARI-OAI  and  the  MARS-GWI.  Verbal 
Ability  did  not  emerge  in  the  factor  analyses  of  abilities  common  to  the  other  two  pairings  (PAQ 
with  ARI-OAI  and  with  MARS-GWI);  cluster  analyses  of  these  pairings'  discriminant  triangles 
classified  the  Reasoning  and  Problem  Solving  factor  as  an  isolate. 


Discussion 

Ability  ratings  of  tasks,  task  composites,  and  NJDs  are  reported  rather  frequently  in  the 
literature;  but  to  our  knowledge,  only  the  PAQ  research  has  heretofore  explored  the  factor 
structure  of  such  ratings  (Jeanneret  &  McCormick,  1969;  Marquardt  &  McCormick,  1973),  and 
we  are  aware  of  no  previous  cross-system  comparisons. 

The  factor  structures  summarized  in  Table  2  are  meaningful  within  their  respective  systems 
and  comparable  across  systems.  The  PAQ  factors  are  near  replications  of  the  principal 
components  derived  by  Marquardt  and  McCormick  (1973)  from  the  same  data  set,  with  the 
exception  that  because  they  rotated  seven  instead  of  eight  factors,  they  did  not  obtain  a  separate 


22 


Mechanical  Ability  factor  (factor  8  in  Table  2).  On  examination,  there  appear  to  be  eight  similar 
factors  between  the  MARS-GWI  and  ARI-OAI  systems  and  six  similar  factors  between  the  PAQ 
and  each  of  the  other  two  systems.  Moreover,  the  eight  MARS-GWI  factors  with  counterparts  in 
the  other  two  systems  showed  the  best  within-system  replication  (between  subsamples).  As 
shown  in  Table  2,  eight  of  those  factors  had  congruence  coefficients  >  .83,  six  of  which  >  .92; 
the  two  MARS-GWI  factors  without  cross-system  counterparts,  on  the  other  hand,  did  not 
replicate.  As  noted,  congruence  coefficients  were  not  computed  for  the  ARI-OAI  and  PAQ 
factors,  because  only  their  average  ability-requirement  rating  matrices  were  available  for  this 
study.  It  seems  likely,  however,  that  their  factor  structures  are  more  stable  than  that  of  the 
MARS-GWI,  because  their  data  involved  larger,  more  homogeneous  groups  of  raters  and 
produced  higher  interrater  reliabilities  (as  shown  in  Table  1). 

The  judged  factoral  comparabilities  across  systems  appeared  to  warrant  an  effort  to  carry  out 
empirical  cross-system  comparisons.  As  described  previously,  these  involved  factor  analyses 
including  only  abilities  that  were  comparable  between  systems.  Subsequently,  cross-system 
congruence  coefficients  could  be  computed  between  factors  with  loadings  on  comparable 
(matched)  abilities.  Judgmental  comparisons  across  the  resultant  factor  structures  produced 
seven  factor  matches  between  the  MARS-GWI  and  ARI-OAI  data  sets  and  six  matches  between 
the  PAQ  and  each  of  the  other  two  sets.  (One  of  the  original  eight  judgmental  matches  between 
the  MARS-GWI  and  ARI-OAI  factors,  Auditory  Ability,  was  lost  when  it  failed  to  emerge  after 
the  variable  reduction  required  for  comparative  analysis.)  The  resultant  matrices  of  congruence 
coefficients  shown  in  Table  3  supported  the  judgmental  cross-system  matches.  With  only  one 
exception  (Visual  Perception,  in  the  comparison  of  the  MARS-GWI  with  the  PAQ),  the 
convergent  values  in  Table  3  are  the  largest  in  their  respective  rows  and  columns,  and  even  that 
one  disparity  does  not  appear  in  the  mean  matrix  shown  in  Table  4.  Separate 
multitrait-multimethod  analyses  of  the  four  matrices  in  Tables  3  and  4  confirmed  that  in  all  cases 
the  mean  convergent  (main-diagonal)  value  was  significantly  larger  than  the  mean  discriminant 
(off-diagonal)  value  (p<.002).  Although  not  large  by  conventional  standards,  under  which 
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factors  from  the  same  measures  are  compared  across  comparable  samples,  the  convergent 
congruence  values  reported  here  seem  substantial  in  light  of  (a)  their  magnitudes  relative  to  the 
much  smaller  discriminant  values  and  (b)  the  likely  attenuating  effects  of  cross-system 
differences  in  scales,  ability  definitions,  job  elements,  and  raters.  Consistent  with  the  rationale 
underlying  multitrait-multimethod  analysis,  moreover,  the  cross-system  differences  make  for 
more  conservative  comparisons. 

These  comparative  analyses  showed  encouraging  cross-system  similarity  in  the 
dimensionality  of  job  elements'  rated  ability  requirements.  There  appear  to  be  six  similar  factors 
across  all  three  systems:  General  Physical  Ability,  Equipment-Control  Sensorimotor  Ability, 
Manual  Ability,  Reasoning  and  Problem  Solving,  Numerical  Ability,  and  Visual  Perception.  In 
addition,  a  Verbal  Ability  factor  emerged  in  both  the  MARS-GWI  and  ARI-OAI  analyses;  and 
an  Aesthetic  Ability  factor,  though  emerging  only  in  the  ARI-OAI  analysis,  is  similar  to  a 
principal  component  derived  by  Marquardt  and  McCormick  (1973)  from  a  comprehensive  set  of 
PAQ  attribute  weights. 

The  MARS-GWI,  ARI-OAI,  and  PAQ  factor  solutions  accounted  for  .86,  .64,  and  .84  of 
their  systems'  total  variance,  respectively,  compared  to  mean  ability  weight  reliabilities  of  .81, 
.92,  and  .90  (see  Tables  1  and  2).  The  proportions  of  total  variance  explained  represent  the 
average  proportions  of  common-factor  variance  (communalities)  in  the  individual  variables, 
whereas  the  mean  reliabilities  represent  the  average  proportions  of  all  systematic  variance 
(common-factor  and  specific)  in  the  variables  (Nunnally,  1978).  Thus,  the  MARS-GWI  and 
PAQ  factor  solutions  appear  to  account  for  almost  all  the  reliable  variance  in  their  respective 
variable  sets,  and  the  ARI-OAI  solution  accounts  for  a  substantial  part  of  that  variance  in  its  set. 
As  noted,  the  MARS-GWI  reliabilities  are  lower  than  those  obtained  from  larger,  more 
homogeneous  groups  of  raters  using  the  behaviorally  anchored  MARS  scales.  It  is  likely  that 
such  ratings  would  contain  systematic  variance  beyond  that  explained  by  the  factor  solution 
presented  here  and  thus  might  yield  a  larger  number  of  factors  than  shown  in  Table  2. 
Nevertheless,  the  results  from  this  study  suggest  that,  at  least  within  the  present  context,  little 
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systematic  variance  would  be  lost  by  condensing  the  individual  ability  weight  vectors  to  a  more 
manageable  number  of  factors.  In  addition  to  imposing  parsimony  on  large  sets  of  interrelated 
variables,  such  factors  could  facilitate  cross-system  comparison  and  classification  and  serve  as 
stable  composites  for  job  requirement  estimation. 

Cluster  analyses  of  the  mean  discriminant  triangles  in  Tables  3  and  4  was  suggested  by 
some  moderate  sized  congruence  coefficients  between  unmatched  factors.  The  solution 
presented  in  Table  5  was  consistent  for  all  four  triangles,  with  the  previously  noted  exception  that 
the  two  six-factor  triangles  did  not  contain  a  Verbal  Ability  factor  (see  footnote  c,  Table  5).  The 
solution  included  two  groupings  and  two  isolates,  titled  as  follows:  General  Sensorimotor 
Ability,  General  Cognitive  Ability,  Numerical  Ability,  and  Visual  Perception.  Interestingly, 
three  of  these  titles  are  similar  to  the  Cognitive,  Perceptual,  and  Psychomotor  ability-requirement 
factors  posited  by  Hunter  (1983)  based  on  analysis  of  test  validity  coefficients.  It  should  be 
noted  that  the  cluster  solution  in  this  study  is  merely  suggestive  of  a  higher-order  classification 
and  does  not  justify  condensation  to  four  ability-requirement  dimensions.  However,  future 
research  should  explore  the  validity  of  a  four-dimensional  model  and  whether  it  can  account  for 
substantial  proportions  of  variance  in  ability-requirement  estimation. 

Research  currently  under  way  is  exploring  the  factor  structure  of  jobs'  ability-requirement 
estimates,  derived  by  combining  their  NJD  ratings  on  the  PAQ,  OAI,  and  GWI  with  the 
previously  described  NJD  ability  weight  matrices.  Preliminary  results  indicate  comparability 
between  factors  underlying  the  job  requirement  estimates  and  those  underlying  the  NJD  ability 
weights  as  reported  in  this  study.  It  is  clear  from  this  preliminary  research,  however,  that  the 
degree  of  differentiation  in  the  job  requirement  factor  structure  depends  upon  the  particular 
algorithm  by  which  job  ratings  are  combined  with  NJD  ability  weights.  Further  research  will 
explore  this  question  and  compare  the  job-component  factors  with  factors  derived  from  experts' 
direct  global  ratings  of  jobs'  ability  requirements.  Another  effort  will  involve  policy  capturing 
analyses  in  which  jobs'  direct  ability-requirement  ratings  (as  a  y  variable)  are  regressed  on  their 
NJD  ratings  or  NJD  factor  scores  (as  multiple  x  variables).  The  resultant  regression  coefficients 
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might  subsequently  serve  as  ability-requirement  weights  for  the  NJDs.  Ultimately,  multitrait- 
multimethod  comparisons  will  be  carried  out  on  ability-requirement  estimates  for  jobs  based  on 
NJD  weights  derived  from  judges'  ratings  (as  described  in  the  present  study)  as  well  as  NJD 
regression  weights  based  on  three  different  kinds  of  y  variables:  (a)  experts’  direct  ability- 
requirement  ratings  of  jobs,  (b)  mean  ability  test  scores  for  representative  samples  of  job 
incumbents,  and  (c)  test  validity  coefficients  for  jobs  (Cunningham  et  al„  1983;  McCormick  et 
al.,  1972;  Sparrow,  1989). 

Although  the  job  component  approach  to  attribute-requirement  estimation  holds 
considerable  promise,  more  methodological  and  construct  validation  research  is  needed  to 
support  it.  The  large  ASVAB  test  data  bank  for  military  jobs  could  prove  useful  in  such  research. 


26 


REFERENCES 

Ballentine,  R.D.,  Cunningham,  J.W.,  &  Wimpee,  W.E.  (1992).  Air  Force  enlisted  job  clusters: 
An  exploration  in  numerical  job  classification.  Military  Psychology,  4,  87-102. 

Campbell,  D.T.,  &  Fiske,  D.W.  (1959).  Convergent  and  discriminant  validation  by  the 
multitrait-  multimethod  matrix.  Psychological  Bulletin,  56,  81-105. 

Cattell,  R.B.  (1966).  The  scree  test  for  the  number  of  factors.  Multivariate  Behavioral 
Research,!,  245-276. 

Christal,  R.  E.  (1968).  Selecting  a  harem--and  other  applications  of  the  policy-capturing  model. 

The  Journal  of  Experimental  Education,  36,  35-41. 

Christal,  R.E.,  &  Weissmuller,  J.J.  (1988).  Job-Task  Inventory  Analysis ,  In  S.  Gael  (Ed.),  The 
Job  Analysis  Handbook  for  Business,  Industry  &  Government  (pp  1036-1050).  New  York: 
Wiley. 

Cornelius,  E.T.,  Hakel,  M.D.  &  Sackett.  P.R.  (1979).  A  methodological  approach  to  job 

classification  for  performance  appraisal  purposes.  Personnel  Psychology,  31,  (2),  355-364. 
Cunningham,  J.W.  (1988).  Occupation  Analysis  Inventory.  In  S.  Gael  (Ed.),  The  Job  Analysis 
Handbook  for  Business,  Industry  &  Government  (pp  975-990).  New  York:  Wiley. 
Cunningham,  J.W.,  Boese,  R.R.,  Neeb,  R.W.,  &  Pass,  J.J.  (1983).  Systematically  derived  work 
dimensions:  Factor  analyses  of  the  Occupational  Analysis  Inventory.  Journal  of  Applied 
Psychology,  68, 232-252. 

Cunningham,  J.W.,  &  Scott,  B.M.  (1988,  August).  The  dimensionality  of  USES  and  OAI 
worker-oriented  job  variables.  In  P.D.  Geyer  &  J.  Hawk  (Chairs),  Occupational  Analysis 
and  the  Dictionary  of  Occupational  Titles.  Symposium  conducted  at  the  96th  Annual 
Convention  of  the  American  Psychological  Association,  Atlanta. 

Cunningham,  J.W.,  Wimpee,  W.E.,  &  Ballentine,  R.D.  (1990).  Some  general  dimensions  of 
work  among  U.S.  Air  Force  enlisted  occupations.  Military  Psychology,  2,  33-45. 

Fleishman,  E.A.  (1967).  Development  of  a  behavior  taxonomy  for  describing  human  tasks:  A 
correlational-experimental  approach.  Journal  of  Applied  Psychology,  5 1 , 1-10. 


27 


Fleishman,  E.A.  (1975, 1990).  (Manual  for  Ability  Requirement  Scales  (MARS):  Form  A 
(Revised).  Fairfax,  VA:  Author. 

Fleishman,  E.A.,  &  Mumford,  M.D.  (1988)  Ability  Requirement  Scales.  In  S.  Gael  (Ed),  The 
Job  Analysis  Handbook  for  Business,  Industry  &  Government  (pp  917-935).  New  York: 
Wiley. 

Fleishman,  E.A.,  &  Quaintance,  M.K.  (1984).  Taxonomies  of  Human  Performance.  Orlando,  FI: 
Academic  Press. 

Fleishman,  E.A.,  &  Reilly,  M.E.  (1992).  Manual  for  Fleishman  Job  Analysis  Survey  (FJAS). 

Palo  Alto,  CA:  Consulting  Psychologist  Press. 

French,  J.W.,  Ekstrom,  R.B.,  &  Price,  L.A.  (1963).  Manual  for  kit  of  reference  tests  for 
cognitive  factors.  Princeton,  NJ:  Educational  Testing  Service. 

Gorsuch,  R.L.  (1974).  Factor  Analysis.  Philadelphia:  Saunders. 

Harvey,  R.J.  (1991)  Job  analysis.  In  M.  Dunnette  and  L.M.  Hough  (Eds),  Handbook  of  industrial 
and  organizational  psychology  (2nd  ed.):  Volume  2  (pp.  71-164).  Palo  Alto,  CA: 
Consulting  Psychologists  Press. 

Hunter,  J.E.  (1983).  The  dimensionality  of  the  General  Aptitude  Test  Battery  (GATB)  and  the 
dominance  of  general  factors  over  specific  factors  in  the  prediction  of  |ob  performance  for 
the  U.S.  Employment  Service  (USES  Test  Research  Report  No.  44).  Washington,  DC:  U.S. 
Department  of  Labor. 

Jeanneret,  P.R.,  &  McCormick,  E.J.  (1969).  The  job  dimensions  of  "worker-oriented"  job 
variables  and  of  their  attribute  profiles  as  based  on  data  from  the  Position  Analysis 
Questionnaire.  Report  No.  2  under  Contract  Nonr-1 100(28),  Office  of  Naval  Research. 
West  Lafayette,  IN:  Occupational  Research  Center,  Purdue  University. 

Kaiser,  H.F.  (1958).  The  varimax  criterion  for  analytic  rotation  in  factor  analysis. 

Psychometrika,  23,  1 87-200. 

Knoeller,  M.C.,  &  Iwaniszek,  J.  (1990).  Manual  for  the  monte  carlo  multitrait-multimethod 
analysis  package  5.0.  Durham,  NC:  Duke  University  Press. 


28 


Landy,  F  J.  (1988).  Selection  procedure  development  and  usage.  In  S.  Gael  (Ed.),  The  Job 

Analysis  Handbook  for  Business,  Industry,  and  Government,  (pp.  271-287)  New  York:  John 

Wiley  &  Sons. 

Marquardt,  L.D.,  &  McCormick,  E.J.  (1972).  Attribute  ratings  and  profiles  of  the  job  elements 
of  the  Position  Analysis  Questionnaire  (PAQ).  Report  No.  1  under  contract  No.  N00014-67- 
A-0226-0016,  Office  of  Naval  Research.  West  Lafayette,  IN:  Occupational  Research 
Center,  Purdue  University. 

Marquardt,  L.D.,  &  McCormick,  E.J.  (1973).  Component  analysis  of  the  attribute  data  based  on 
the  Position  Analysis  Questionnaire(PAQ).  Report  No.  2  under  contract  No.  N00014-67-A- 
0226-0016,  Office  of  Naval  Research.  West  Lafayette,  IN:  Occupational  Research  Center, 
Purdue  University. 

Mecham,  R.C.,  &  McCormick,  E.J.  (1969).  The  rated  attribute  requirements  of  job  elements  in 
the  position  analysis  questionnaire.  Report  No.  1  under  contract  Nonr-1 100  (28),  Office  of 
Naval  Research.  West  Lafayette,  IN:  Occupational  Research  Center,  Purdue  University. 

McCormick,  EJ.  (1979).  Job  Analysis:  Methods  and  Applications.  New  York:  AMACOM. 

McCormick,  E.J.,  Cunningham,  J.W.,  &  Thornton  G.E.  (1967).  The  prediction  of  job 

requirements  by  a  structured  job  analysis  procedure.  Personnel  Psychology,  20, 431-440. 

McCormick,  E.J.  DeNisi,  A.S.,  &  Shaw,  J.B.  (1979).  Use  of  the  Position  Analysis  Questionnaire 
for  establishing  the  job  component  validity  of  tests.  Journal  of  Applied  Psychology,  64  (1), 
51-56. 

McCormick,  E.J.,  Jeanneret,  P.R.,  &  Mecham,  R.C.  (1972).  A  study  of  job  characteristics  and 
job  dimensions  as  based  on  the  Position  Analysis  Questionnaire  (PAQ).  Journal  of  Applied 
Psychology,  56,  347-368. 

McCormick,  E.J.,  &  Jeanneret,  P.R.  (1988).  Position  Analysis  Questionnaire  (PAQ).  In  S.  Gael 
(Ed.),  The  Job  Analysis  Handbook  for  Business,  Industry  &  Government  (pp  825-842). 

New  York:  Wiley. 


29 


Neeb,  R.  W.,  Cunningham,  J.  W.,  &  Pass,  J.  J.  (1971).  Human  attribute  requirements  of  work 
elements:  Further  development  of  the  Occupation  Analysis  Inventory.  Ergometric  R  and  D 
Report  No.  4  under  Grant  No.  OEG-2-7-070348-2698  from  the  U.  S.  Office  of  Education. 
Raleigh:  Center  for  Occupational  Education,  North  Carolina  State  University.  In  JSAS 
Catalog  of  Selected  Documents  in  Psychology,  4, 145.  (Ms.  No.  805) 

Nunnally,  J.C.  (1978).  Psychometric  theory.  New  York:  McGraw-Hill. 

Pass,  J.J.,  &  Cunningham,  J.W.  (1975).  A  systematic  procedure  for  estimating  the  human 
attribute  requirements  of  occupations.  Ergometric  R  and  D  Report  No.  1 1  under  Contract 
No.  NC-C-00-3-0070,  National  Institute  of  Education.  Raleigh:  Center  for  Occupational 
Education,  North  Carolina  State  University.  In  JSAS  Catalog  of  Selected  Documents  in 
Psychology,  5, 353.  (Ms.  No.  1151) 

Peterson,  N.G.,  &  Bownas,  D.A.  (1982).  Skill,  task  structure,  and  performance  acquisition.  In 
Dunnette,  M.D.,  &  Fleishman,  E.A.  (Eds.),  Human  performance  and  productivity:  Human 
Capability  Assessment.  Hillsdale,  NJ:  Lawrence  Erlbaum. 

Sarle,  W.S.  (1982).  Cluster.  In  A. A.  Ray  (Ed.),  SAS  user's  guide:  Statistics  (pp.  423-431). 
Cary,  NC:  SAS  Institute,  Inc. 

Sarle,  W.S.,  &  Sail,  J.P.  (1982).  Factor.  In  A.A.  Ray  (Ed.),  SAS  user's  guide:  Statistics  (pp.  309- 
345).  Cary,  NC:  SAS  Institute,  Inc. 

Sparrow,  J.J.  (1989).  The  utility  of  PAQ  in  relating  job  behaviors  to  traits.  Journal  of 
Occupational  Psychology,  62, 151-162. 

Ward,  J.H.,  Jr.,  &  Hook,  M.E.  (1963).  Application  of  an  hierarchical  grouping  procedure  to  a 
problem  of  grouping  profiles.  Educational  and  Psychological  Measurement,  23,  69-81. 

Winer,  B.J.  (1971).  Statistical  Procedures  in  Experimental  Design.  NY:  McGraw-Hill. 


30 


Author  Notes 


Requests  for  reprints  should  be  sent  to  J.  W.  Cunningham,  Department  of  Psychology,  Box  7801, 
North  Carolina  State  University,  Raleigh,  NC  27695-7801. 

Acknowledgements 

Research  for  this  article  was  partially  supported  by  the  Human  Resources  Directorate  of  the 
Air  Force  Armstrong  Laboratory. 

We  are  indebted  to  Edwin  A.  Fleishman  for  his  generous  permission  to  use  the  Manual  for 
Ability  Requirement  Scales  in  our  research,  and  to  P.  Richard  Jeanneret  for  his  helpful  advice 
regarding  ability-requirement  data  and  factors  for  the  Position  Analysis  Questionnaire.  We  also 
thank  all  the  raters  who  participated  in  this  research  effort  and  the  three  anonymous  reviewers  for 
their  helpful  suggestions. 

The  views  expressed  herein  are  the  authors'  and  do  not  necessarily  reflect  the  views  of  the 
U.  S.  Air  Force,  other  services,  or  the  U.  S.  Department  of  Defense. 


31 


